REGULARITY AT INFINITY OF REAL MAPPINGS AND A 

MORSE-SARD THEOREM 



L.R.G. BIAS, M.A.S. RUAS, AND M. TIBAR 

Abstract. We prove a new Morse-Sard type theorem for the asymptotic critical values 
of semi-algebraic mappings and a new fibration theorem at infinity for mappings. 
We show the equivalence of three different types of regularity conditions which have 
been used in the literature in order to control the asymptotic behaviour of mappings. 
The central role of our picture is played by the i-regularity and its bridge toward the 
/9-regularity which implies topological triviality at infinity. 



1. Introduction 

Let / : — )■ W, for n > p > and IK = M or C, be a non-constant polynomial map- 
ping. It is well-known that / is a locally trivial topological fibration over the complement 
of the bifurcation set B{f), also called the set of atypical values. The atypical values may 
come from the critical values but also from the asymptotic behaviour of the fibres. One 
can easily see this in the example f{x, y) = x + x^y, where the value G IK is not critical 
but there is no trivial fibration in any neighbourhood of 0. 

A complete characterization of B{f) is available only in the case n = 2 and p = 1, 
see [HaLe] for K = C and [TZ] for IK = M. One has therefore imagined various ways to 
approximate B{f), essentially through the use of regularity conditions at infinity. For p = 
1 and IK = C, Broughton worked with a Palais-Smale type condition called tameness [Br], 
later extended by Nemethi [Ne] and Nemethi-Zaharia [NZ] to quasi-tame and M-tame. 
Parusinski used the Malgrange condition [Pal], which is a Lojasiewicz type condition at 
infinity, and versions of it. Siersma and Tibar worked with the t-regularity (also called 
t-equisingularity) [ST, Ti4], which is a type of non-characteristic condition at infinity, see 
also [Pal]. Over M and still for p = I, the t-regularity and the p-regularity were considered 
in [Til, Ti3]. One finds a detailed discussion of the relations between these conditions in 
[NZ], [Du] for the complex setting and in [Ti3, Ti5] for the real and complex settings. 

Let us turn to the case of mappings, i.e. p > 1. In his study [Ga3] of polynomial 
mappings / : C" — > C^, Gaffney defines a generalized Malgrange condition and proves 
that this yields a set Ac of non-regular values containing B{f). He uses the theory of 
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integral closure of modules to relate his condition to a non-characteristic condition like 
Parusinski's [Pal]. 

In [KOS], Kurdyka, Orro and Simon considered semi-algebraic maps / : K" — W 
and a metric type regularity condition which had been introduced by Rabier [Ra]. They 
define a set of asymptotically critical values K^oif) and show the inclusion A^os ^ B{f), 
where A^os '■= /(Sing/)U-fCoo(/)- Remarkably, they prove that K^oif) is a semi-algebraic 
set of dimension <p — 1. Their condition, which we shall call here KOS -regularity, is a 
different extension of the Malgrange condition. It was established by Jelonek [Jel, Je2] 
that these two generalizations of the Malgrange condition are actually equivalent, see 
Remark 4.5. 

In each of the above cases, showing that some set A of non-regular values is semi- 
algebraic (or algebraic, in the complex case) of dimension < p — 1 and contains B{f), 
means to prove an asymptotic Morse-Sard type theorem together with a fibration theorem 
for the non-proper mapping /. 

In our paper, the central object is the t-regularity in the setting of semi-algebraic 
mappings / : M" — M^, which is a geometric grounded condition. Following Gaffney, 
the interpretation in terms of integral closure of modules (Proposition 4.3) allows one to 
prove that the t-regularity is equivalent to the Malgrange-Gaffney condition reformulated 
over M (Theorem 4.4). Due to the technique, this holds within the class of "fair" maps 
[Ga3, p. 159 and Prop. 2], see also §4.2. 

Our Theorem 3.1 tells that the t-regularity is equivalent to the /('OS'-regularity, pro- 
viding a bridge between conditions of very different flavor. This new result together with 
Jelonek's above mentioned theorem establishes a "triangle" of equivalences in Figure 1. It 
also shows that the equivalence of the t-regularity with the Malgrange-Gaffney condition 
holds under general conditions, i.e. without the "fair" assumption and without using at all 
the integral closure interpretation, see Example 5.10. This is also a far reaching extension 
of the equivalence proved for p = 1 in [ST, Pa2]. 

We pursue by showing that t-regularity implies Pe -regularity, a Milnor type condition 
of transversality of / to the Euclidean distance function Pe, extending a result proved for 
p = 1 in [Ti3]. The p-regularity enables one to deflne the set of asymptotic non p-regular 
values S{f) C W, and the set A^ := /(Sing/) U S{f). 

Then Theorem 5.7 tells that the subset >S'(/) is closed semi-algebraic and of dimension 
< p — 1. Moreover, Theorem 5.7(c) shows that there is a locally trivial flbration induced 
by / on the complement MP \ Ap^^, under the more general setting of a C^-mapping 
/ : X — 7- on a submanifold X C M". Our fibration result is based on a new result. 
Proposition 6.4, which is a fibration theorem "at infinity" , i.e. holding in the complement 
of a sufficiently large ball. We show in Corollary 5.8 the inclusions Ap^ C AkoSi and more 
particularly S{f) C Koo{f), which inclusions may be strict, cf Example 5.9. Therefore 
Theorem 5.7 represents an asymptotic Morse-Sard type theorem which refines the one 
by Kurdyka, Orro and Simon [KOS]. In particular, the key result dimii'oo(/) < p — 1 of 
[KOS] is superseded by dimS'(/) < p—1 (cf Theorem 5.7(b)). Our proof is of a completely 
different flavor and is based on the existence of partial Thom stratifications at infinity, cf 
Deflnition 6.2, and on the link between t-regularity and p-regularity. 
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Let us also point out that our definitions of regularity conditions as well as our state- 
ments involving them have a local-at-infinity counterpart, i.e. formulated at some fixed 
point po on the boundary at infinity of the graph of / in P" x MP. 

Figure 1 presents our results in a condensed manner. 



Malgrange-Gaffne> 
condition 



Jelonek's ^ 




topological 
triviality at infinity 



Figure 1. Synopsis 



2. Asymptotic regularity conditions for mappings 

We introduce the main definitions leading to the notion of t-regularity, then define the 
Malgrange-Gaffney regularity and the J'i'O S'-regularity. 

2.1. Conormal spaces. Let X C be a real semi-algebraic subset. We denote by X^^g 
the set of regular points of X and by Xging the set of singular points of X. We assume 
that X contains at least a regular point. 

Definition 2.1. Let 

C{X) := closure{(x, H) G X,^g x P^'^ | T,.X,eg C H} CX x f""-^ 

be the conormal modification of X. Let n : C{X) — )■ X denote the projection. 

Definition 2.2. Let (7 : X — )■ M be an analytic function defined in some neighbourhood 
of X in M'". Let Xq denote the subset of X^-^g where g is a submersion. The relative 
conormal space of g is defined as follows: 

Cg{X) := closure {(x,//) G Xq x P™"! | T^{g-\g{x))) C H} cX x P™-\ 

together with the projection tt : Cg{X) — )■ X, 7r(x, H) = x. 

For some y E X such that g{y) = 0, let Cg^y{X) := Tx^^{y). The following result shows 
that Cg^y{X) depends on the germ oi g &t y only up to multiplication by some invertible 
analytic function germ 7. It was stated for analytic X but holds for semi-algebraic. 
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Lemma 2.3. [Ti5, Lemma 1.2.7] 

Let 7 : (]R™,y) W be an analytic function such that^iy) ^ 0. Then C^g^y{X) = Cg^y{X). 

□ 

2.2. Characteristic covectors and t-regularity. Let X C be semi-algebraic and 
let / : X — >■ be a semi-algebraic mapping with n > p. We use coordinates 
(xi, . . . ,Xn) for the space and coordinates [xq '■ Xi : . . . : for the projective space 
P"". We denote by H°° = {[xo '■ Xi : . . . : x„] G | Xq = 0} the hyperplane at infinity. 

Let X := graph/ be the closure of the graph of / in P'^ x W and let := Xn {H'^ xRp). 
One has the semi- algebraic isomorphism graph/ ^ X. 

We consider the affine charts Uj x W of P*^ x M^, where Uj = {xj 7^ 0}, j = 0, 1, . . . , n. 
Identifying the chart Uq with the affine space M", we have Xn(f/o x MP) = X\X°° = graph/ 
and X°^ is covered by the charts Ui x W, . . . ,Un'x MP. 

If g denotes the projection to the variable Xq in some affine chart Uj x M^, then the 
relative conormal Cg(X\X°° fl Uj x Rf) C X x P"+p-i is well defined, with the projection 
7r(t/, H) = y. Let us then consider the space 7r^^(X°°) which is well defined for every chart 
Uj X as a subset of Cg(X\X°° n Uj x Rp). By Lemma 2.3, the definitions coincide at 
the intersections of the charts. We therefore have: 

Definition 2.4. We call space of characteristic covectors at infinity the well-defined set 
C~ := 7r-i(X°^). For some po e X°°, we denote := n-\po). 

Let r : P" X M''' — denote the second projection. One defines the relative conormal 
space Ct-(P" x MP) like in Definition 2.2 where the function g is replaced by the application 
r. 

Definition 2.5. We say that / is t-regular at po e X°° if C^(P" x Rp) n C;^ = 0. 

2.3. Interpretation of the t-regularity in local charts. Let / = (/i, . . . , /p) : R" — )• 

RP be a semi- algebraic mapping and let po G X°°. Up to some linear change of 
coordinate one may assume that Pq G X°° fl [Un x Rp). In the intersection of charts 
(f/o n Un) X RP, one considers the change of coordinates Xi = yi/yo, ■ ■ ■ ,Xn-i = y-n-i/yo, 
Xn = I/1/05 where (xi, . . . , Xn) are the coordinates in Uq and (?/o, . . . , yn-i) are those in 
Un- Then for z = 1, . . . ,p, we define: 

Fi{y, t) = Fi{yo, yi, . . . , yn-i, ti, . . . , tp) := fi{ — , . . . , — ) - ti 

Vo yo yo 

and F{y, t) := {F,{y, t), . . . , t)). Then X n ((f/o H f/„) x Rp) = f] {F^{y, t) = 0}. 

4 = 1 

Let fiQ = (1,0, ... ,0) G R" X RP denote a normal vector to the hypersurface {yo = 
constant} and, for 2 = 1, . . . ,p, let us consider a normal vector to {Fj = 0} at {y,t) G 
X n ((t/o n Un) X RP), as follows: 

ni{y,t) = VFi{y,t) = {VnFi{y,t),VpFi{y,t)), 

where 

V„F.(,, t):^[-iy,t),-, ^fe. ) . V^f.fe. := (-(,. t),..., -(y, i) j . 
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By Definition 2.5, / is not t-regular at po G X°° if and only if there exists a sequence 
{{Uk, tk)}km C X n {{Uo n Un) x W) such that {yk, tk) — > po and the tangent hyperplanes 
to the fibres of g\x at {yk,tk) tend to a hyperplane H such that its normal line has a 
direction of the form [0 : bi bp] in P"+p^i. More explicitly, there exists a 

sequence {(V'oa:, ^ifc, • • • , ippj}km C M*'+^ such that the limit hm^^oo Zlf=o i^ikniivk, tk) of 
the linear combination of normal vectors Ui has the direction uh = [0 : : . . . : : 6i : 

...■.bp]e P"+p-i. 

2.4. ii'OS'-regularity. Kurdyka, Orro and Simon defined in [KOS] a regularity condition 
at infinity for mappings / : — > which contains the Rabier function u, cf [Ra], 
and compared it to the Kuo distance function [Ku]. Jelonek [Jel, Je2] compared it to the 
generalized Gaffney function, see Remark 4.5. 

Let / : M" — )■ be a nonconstant semi-algebraic mapping, where n > p. 

Definition 2.6. [KOS] The set of asymptotic critical values of f is defined as: 
Kooif) := {teMF\ 3{xj}jeN C M", lim ||xj|| = oo, 

lim /(xj) = t and lim ||xj ||z/(D/(xj)) = 0} 

where p{A) := m^^\\=i \\A*{<^)\\, for A G £(M",Mp). 

We shall reformulate this condition in a localized version, at some point at infinity 

Po e x°°. 

Definition 2.7. Let graph/ C X C P" x M^' be a fixed embedding. We say that po G X°° 
is an asymptotical critical point of f if and only if there exists {xjjjgp^ C MJ^ ~ graph/ 
such that limj_>.oo(xj, /(xj)) = Pq and that r(po) G K^{f). 

We say that t^ G is a KOS -regular value of / if ^ -^oo(/)- We say that po G X°° 
is a KOS -regular point whenever po is not an asymptotical critical point of /. 

Let us remark that the notion of i^O S'-regular point depends on the embedding of R"-, 
whereas the ii'OS'-regular values do not. 

2.5. Malgrange-Gaffney condition. Following [Ga3], let / : — )■ be a semi- 
algebraic mapping and let / be multi-index with I = {ii < 12 < . . . < ip). One denotes 
by Mi[f) the maximal minor of the Jacobian matrix of / formed from the columns indexed 
by / and by Mj{j, f) the minor of the Jacobian matrix of size [p — 1) x (p — 1) using the 
columns indexed by J, and all the rows of the Jacobian matrix except for the j-th row. 
If p = 1, then, by convention, Mj{j, /) = 1. 

Definition 2.8. Let {x^j^gN be a sequence of points in and let us consider the following 
properties: 

(Li) ||xfc|| — 00 and /(x^) — to, as A; —t- 00. 
(L2) (xfc, /(xfc)) ^ Po G X°°, as /c ^ cx). 

After [Ga3], we say that the fibre /~^(to) verifies the Malgrange-Gaffney condition if 
there is 5 > such that, for any sequences of points {x/tj^gN with property (Li) one has 



Localizing this condition, we shall say that / verifies the Malgrange-Gaffney condition 
at po G if there is 5 > such that the above inequality holds for any sequences of 
points with property (L2). 

It follows that /~^(to) verifies the Malgrange-Gaffney condition if and only if / verifies 
the generalized Malgrange-Gaffney condition at any point po G r~^(to) H X°°. 

3. Equivalence of regularity conditions 

With the above definitions and notations, we have: 

Theorem 3.1. Let / : M" — MP be a non-trivial semi-algebraic mapping, n > p > 0. 
Let Pq G . Then the following are equivalent: 

(a) / is t-regular atpQ. 

(b) / is KOS -regular atpQ. 

(c) / verifies the Malgrange-Gaffney condition atpQ. 



Proof. We shall prove (a)<(=^(b). 

One may assume (eventually after some linear change of coordinates) that Pq G fl 
[Un X MP) and that we have \xn\ > |a;i|,« = — 1, for x G in some neighbourhood 

of Po. 

(a)^(b). By definition, if po is an asymptotical critical point of / and there- 
fore to := r(po) is an asymptotical critical value, then there exist sequences {x^ : = 
{xik, . . .,Xnk)}k£N C M" and {tpk = (V^ife, • • ■,i^pk)}keN C with W^JkW = 1 and tpk ^, 
such that (xfc, /(x^)) -> and that: 



(2) 



dXr 



^ 0. 



,'i=i ^ 1=1 

Since for large enough k we have \xnk\ > \xik\, i = 1, . . . ,n — 1, one may replace in (2) 
||xfc|| by \xnk\, then multiply the sums by Xnk- 

In the notations of §2.3, by changing coordinates within UoClUn, one has y^ = 1/xn, yt = 
Xi/xn and the relations: 



dy. (1/'^) — ^"axi 



(3) { '^M = -Si,, 



dt. 
dFi 



1 < i < n — 1, 1 < j < p, 
l<J,l<P, 



Oy^iy, t) = -Xn{Xi^^{x) + ... + Xn^{x)), 1 < J < p. 

Then the condition (2) implies: 



(4) 



The vector 



,i=l 
P 



dR 



dVn-l 



^ 0. 



■■= [ 0,^?/;ifc^(yfc,tfc),...,^V^ifc^^(yfc,tfc),-^ 



1=1 



dy 



i=l 
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dyn^ 



Ifc, • • • , — v^pfc 



is a linear combination of the normal vectors f?j defined in §2.3 with coefficients i/^ik, thus 
the hyperplanes are tangent to the levels of the function g\x- We have 

n-Hk n = [0 : : . . . : : ipi : . . . : ipp] 

which shows that the limit tangent hyperplane H = limfc_>.oo H^, to which n is normal, 
belongs to C^. This implies that / is not t-regular at Pq. 

(b)=^(a). Reciprocally, let po G X°° be not t-regular. Then there exist some sequence of 
points {(yfc, tfc)}fceN C X fl {{Uq fl Un) x M^) tending to po, and a sequence of hyperplanes 
Hk tangent to the levels of g at (yfc,tfc), such that Hj. -^■ G C^. This means that 

there exist sequences {tpk = {ipik, ■ ■ ■ ,ippk)}km C MP and {AfcjfcgN C M such that nH^. = 



hnoijk, tfc) + J2i i^ikniijk, tfc) and that limfc^oo ^//^ 



: 



0:^1 



: 



where 



ipi, . . . ,ijjp] 7^ (0, . . . , 0). By assumption we have that fi//^ is the vector: 



i=l 



i=l 



We may actually take := ^'Yl^i=i'^ik^^{Yk-i^k) and we have, after dividing out by 

where := ^ and 



/ifc := IK^ifc, • • • ,^pfc)||, that limfc^oo^/ffc = (0,0, . . . ,0,?/^i, 
IKV'ifc, • • • , V^pfc)|| = 1- This implies that: 

p 

(5) 



lim V'^/'jfc^(yfe,tA,.) = 0, 



1=1 



for any 1 < j < n — 1. 

By using (3), this is equivalent to: 



(6) 



lim Xnk V^ifc7r^(xfc) = 



dXi 



and one has > ;^||xfc|| for large enough k. Therefore, in order to get the limit (2) it 
remains to prove that (6) is true for j = n. The rest of our argument is devoted to this 
proof. 

From the relations (3) we get Xn§^{x) = — ^^Zlnj^iy^'t) and therefore: 



^ df "^^ ^ dF- ^ dF- 

^^ifcXnfc— ^(xfc) = - ^^i/jfc^ifc o-^(yfc,tfc) - ^V^ife|/ofc^(yfc,tfc). 



i=l " j=l i=l i=l 



9yj 



We show that both terms of the right hand side tend to zero. First we have: 

p 



n-l p 

^^yjk^ik^{Yk,tk) 
j=i i=i 



Since by hypothesis we have \yj]. 



< 


Xfc 








•^nk 





EdFi dFi 
Vik-^{jk,tk), . . . ,z^Vik^ (yfc,tfc)) 



right hand side tends to as — )■ oo. 



1 — 1 < 1 for large enough k, we get from (6) that the 



Let us assume that the following inequality holds for large enough k ^ 1, the proof of 
which will be given below: 



(7) 



i=l 



kUok 



dF,, 



dyo 



i=l 



oyi 



^ , dF, ^ dF, ' ^ OF,. 



OVn-l Oil 
i=l ^ i=l ^ 



i=l 



Then, by using (5), (7) and the equality XliLi ^ik^ = —i'jk for any I < j < p (implied 
by (3)), we get: 



kVok 



dF. 



dyo 



which shows that limfc_>.oo XliLi ll'^«fcl/ofcf^(yfc) = 0. This completes our proof of the 
relation (2) showing that po is not A'OS-regular. 

Let us now give the proof of (7). If this were not true, there exists 6 > such that for 
k ^ 1 one has: 



ZlLi i'ikyok^iyk, ^k] 



> S. 



Then the set W = e {{UnnUo)xWxRP)n{XxSf^^) \ (8) holds for ((y, t), t/-)} 

is a semi-algebraic set. We have {(jk,tk),'ipk) G W for A; ^ 1, thus (poj'ip) € 
W. Then, by the curve selection lemma [Mi, p. 25] there exists an analytic curve 
A = {(f),^lj) : [0,e[^ W such that A(]0,e[) C W and A(0) = (po,^)- We denote 
'Pis) = (yo(s),l/i(s), . . . ,l/n-i(s),ti(s), . . . and ip{s) = (^i(s), . . . , ^p(s)). Since 

F(0(s)) = 0, we have: 



n-l 



r/ (9/^ 



Multiplying by we obtain: 

dyo 



i=l 



i=l 



dti 



Since (j) is analytic, thus bounded at s = 0, by applying the Cauchy-Schwarz inequality 
one finds a constant C > such that: 



(9) 



iyois)Y.^^{s)-^i<P{s)) 



i=l 



c 



dyo 

m 

'dyi 



< 



p fjfp p fjp p pifp p fjfp 



. , -a. . -, dyn-i dti 

t=i 1=1 1=1 



■ 1 

1=1 ^ 



We have / := oTdsyQ{s) > and ords|/o(s) = / + !>! since yo{0) = 0, thus 
\yo{s)EUUs)^^{(l>{s)) « yois)EUUs)^^{(l>{s)) , which, together with (9), gives: 



1=1 



dyo 



This contradicts our assumption that {(j){s),tlj{s)) G W, for s E]0,e[. 

The equivalence (b)-v^(c) has been proved by Jelonek [Jel], [Je2] in a shghtly more general 
setting. 

□ 



4. Integral closure interpretation of ^-regularity and 
Malgrange-Gaffney Condition 

In the setting of complex polynomial mappings / : C" — C^, one observed that t- 
regularity has an integral closure interpretation, cf [Ti4, Remark 2.9] for p = 1 and [Ga3] 
for p > 1. Actually Gaffney described in terms of the integral closure of modules a non- 
characteristic condition for p > 2 [Ga3, Def.l] which turns out to be equivalent to the 
t-regularity. His technique works under the supplementary assumption that / is "fair", 
see below. Let us first give the interpretation of the t-regularity of polynomial mappings 
/ : — 7- W which are fair. We then prove the real counterpart of Gaffney's result [Ga3, 
Theorem 17]. 

4.1. Real integral closure of modules. Let us denote by An the local ring of real 
analytic function germs at the origin in M" and by the free ^^-module of rank p. One 
denotes by Ax,x the local ring of real analytic function germs on the real analytic space 
germ (X, x) and by A^x x ^x,x-niodule of rank p. 

Definition 4.1. [Gal, Def. 4.1] Let (X, x) C (M"',x) be a real analytic germ and let 
M be a y4x,x-submodule of AF^^- The real integral closure of M, denoted by M, is the 
set of elements h G A^x x such that for any analytic path (p : (M, 0) — )■ {X,x), we have 
ho (j) ^ Ai{(j)*{M)), where Ai{4>*{M)) denotes the ^i-submodule of Ai generated by the 
elements w o (p^ Vw G M. 

In the complex setting one has some equivalent definitions, see for example [Gal, Prop. 
1.7, 1.11], which hold in the real setting except of [Gal, Prop. 1.7] where it is necessary 
to assume that the regular points of X are dense in X, see [Gal, p. 318]. 

There is an interpretation of the conormal in terms of the integral closure of modules 
in the complex setting, see for instance [Ga2, GTW]. The next result was formulated in 
[Ga3, Prop. 4] in the complex setting but one can show that it holds over the reals if one 
assumes that the regular points of X are dense, see [Di] for the details and generalization. 
Under the notations of §2.1 one has: 
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Lemma 4.2. Let {X,x) C (M'",x) be an equidimensional real analytic germ defined by a 
mapping germ F : {W^,x) — (M^'jO). Suppose that the regular points of X are dense in 
X. Let g : (M^jx) — ?■ M and denote G := {F,g). Let V C M™ be a linear subspace. Then 
the following are equivalent: 

(a) There exist H G Cg^x{X) such that H D V. 

(b) JMx{G)v $ JMx{G), where JMx{G)v denotes the Ax,x-submodule o/^^^ gen- 
erated by I'i^ifj^ + . . . + Vm.-§^]^v = (fi, . . . ,Vm) G , and JMx{G) denotes the 
Ax,x-submodule of generated by |fq-, • • • , ^^|- 

□ 

4.2. The "fair" condition. Let / = (/i, . . . , fp) : M" — M*' be a polynomial mapping and 
let /.( ) denote the homogenization of fi of degree di := deg /j, for 1 ^ i ^ p. 
Let: 

p 

2 = f] |Fi(xo, Xi,...,Xn,ti,...,tp) := fi{xo, Xi, . . . , x„) - tixf = o} C P" x 

i=l 

and compare to the definition of X in §2 and to the notations in §2.3. 

One notices the inclusion X C Z and the equality X\ H°° x W = Z \ H°° x W. At 
any po G X°° we may use the equations of Z in the open subspace Z \ if °° x ~ M". 
However, one does not have the equality X = Z in general. Gaffney works in [Ga3] with 
the space Z assuming the equality Z = IL which he translates by "/ is fair" [Ga3, p. 158]. 
This is imposed by the theory of integral closure of modules since "fair" implies that the 
regular points of Z are dense in Z and that Z is equidimensional analytic. See Example 
5.10 in which X 7^ 2 and therefore this technique does not apply, whereas the statement 
and proof of the equivalence result Theorem 3.1 hold true. 

4.3. t-regularity and fair polynomial mappings. Let / = (/i, . . . , /p) : M" — )■ M*' be 
a fair polynomial mapping. As in §2.2, we consider the charts Uj x MP of P" x R^, where 

~ {^j 7^ 0}' J = O5 1) • • • ! ''^ we identify the chart Uq with the affine space R". 
Let po e X°°. Up to some linear change of coordinate one may assume that Pq G 
X°° n {Un X MP). In the chart Un x R^, one considers the change of coordinates yo = 
Xo/Xn, • • • , yn-1 = Xn-i/xn- In this Coordinate system and since / is fair, one has 

p 

X n (f/„ X R^') = Pi t) = f,{yo, . . . , yn-i, 1) - t,y^^ = o} . 

i=l 

Proposition 4.3. Let / : R" — R^ 6e a fair polynomial map. Then f is t-regular at 
Po G X°° if and only if one of the following equivalent conditions is satisfied: 



(10) dF/dt,e{dF/dy,,...,dF/dyn^,}, Wi = l,...,p. 



(11) dF/dt, G {yodF/dyo, dF/dyi, . . . , dF/dyn-i}, = 1, . . . ,p. 
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Proof. Let \^ := x C M" x W. By Definitions 2.4 and 2.5, po is a t-regular point if 
and only if tliere are no hyperplanes H D V such that H G C^. By Lemma 4.2 apphed 

for G = {F, g) and V, this is equivalent to the following: 



dG dG dG dG ] ^ 
dti [ dyo dyi dyn~i ) 

By Definition 4.1, (12) means that for any : (M, 0) — )■ {'K,po), there exist Aq, Ai, . . . 
A„_i G .4,1 such that: 

i(f )) ) . A.(.) ( f » ) +A,(.) ( )) ) +. . .+A„_,(.) ( ^W^') 

which is in turn equivalent to (10). 

That (10) implies (11) is obvious. The converse is the same as Gaffney's proof of [Ga3], 
holds over the reals too and is based on Parusinski's proof [Pal, Lemma 3.2]. □ 

Theorem 4.4. A fair polynomial mapping / : M" — t- satisfies the Malgrange- Gafjney 
condition at po G X°° if and only if f is t-regular at this point. 

Proof. That / is t-regular at po is equivalent to (11) of Proposition 4.3. In turn, by [Gal, 
Prop. (1.7)] which hold over M too since / is fair, see [Gal, p. 318] and [Di], this is 
equivalent to: 



(13) yt'MjU. F) e {Mj{F)),j = 1, . . . ,p, 

where {Mj{F)) denotes the ideal generated by the p x p minors of the matrix whose 
columns are {yodF/dyo, dF/dyi, . . . , dF/dyn-i), and Mj{j, F) is a maximal minor of the 
same matrix with the jth row deleted. 

Using [Gal, Prop 4.2], one has that (13) is equivalent to the existence of C > such 
that: 

snp\\yt^\\\Mjij,F)iy,t)\\<Gsnp\\MjiF)iy,t)\\. 

p 

Dividing both sides by ||yo ll) where /c = ^((i; — 1), and using properties of determinant 

1=1 

and the following relations between the partials of / and the partials of F: 

' '4/yo~' = W;^ l<z<n-l, l<j<p, 

^ = -y}5ij, l<J,l<P, 

we obtain 

(14) sup||1/x„||||M;(j,/)(x)|| <Csup||M;(/)(x)||, 

J,j I 

where the M' matrices are defined as follows. If / = (ii < . . . < ip) with ii ^ 1, i.e., if 

the matrix indexed by I does not contain the column yodF/dyo then Mj{f) = Mj{f), 
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and otherwise, one replaces the column vector with the df /dxn terms by ^ —df/dxi. 

1=1 ^" 

A similar substitution should be made to define the Mj{j, f) terms. 

Using the fact that ||x„,|| > for j = 1, . . . ,n, the inequality (14) is equivalent to 

generalized Malgrange-Gaffney condition (1). □ 

Remark 4.5. Jelonek [Je2, Jel] proved directly that the Malgrange-Gaffney condition 
(actually in a more general form) is equivalent to the A'OS-regularity, by comparing the 
corresponding functions to the Kuo distance function [Ku]. 

5. Atypical values and fibrations at infinity 

Definition 5.1. Let X C M" be a submanifold and let / : X — )■ be a C^-mapping, 
where p < dimX. One says that to G is a typical value of / if there exists a disk 
D gMJ' centered at to such that the restriction f\ : f~^{D) — t- £) is a topologically trivial 
fibration; otherwise one says that to is atypical. We denote by B{f) the set of atypical 
values of / (or the bifurcation locus of /). 

Note that by definition B{f) D Imf \ Imf and that the fibres of / depend on the 
connected components of W \ B{f ). 

5.1. p-regularity. Let K C be some compact (eventually empty) set and let p : 
\K ^ M>o be a proper analytic submersion. Let / : X — )■ be a C^-mapping, where 
X C M"" is a submanifold. 

Definition 5.2 (p-regularity at infinity). We say that / is p-regular at pq e X°° if 
there is an open neighborhood U C P" x of po ^-nd an open neighborhood D (ZW oi 
t{po) such that, for all t G D, the fibre /~^(t) HU intersects all the levels of the restriction 
P\urm." cind this intersection is transversal. 

We call Milnor set the critical locus Sing(/, p) and we denote it by A4.{f). 

We say that the fibre f~^{to) is p-regular at infinity if / is p-regular at all points 
po e X~ nr-i(to). We call: 

S{f) := {to G MF I 3{xj}jeM C M{f), lim \\xj\\ = oo and lim f{xj) = to}. 

the set of asymptotic p-nonregular values. We denote Ap := /(Sing/) U S{f) and call it 
the p-bifurcation set. 

Remark 5.3. The definition of p-regularity at infinity of a fibre /~^(to) does not depend 
on any proper extension of /, since it is equivalent to the following: for any sequence 
{xfcjfceN C M^, ||xfc|| — )■ oo, /(xfc) — > to, there exists some ko = ko{{xk}keN) such that, if 
k > ko then / is transversal to p at x^. It also follows from the definition that if /~^(to) 
is p-regular at infinity then this fibre has at most isolated singularities. 

The transversality of the fibres of / to the levels of p is a "Milnor type" condition. In 
case p is the Euclidean norm, denoted in this paper by p^;, this condition has been used by 
John Milnor in the local study of singular functions [Mi, §4,5]. For complex polynomial 
functions, transversality to big spheres (i.e. p£;-regularity, in our definition) was used in 
[Br, pag. 229] and later in [NZ], where it is called M-tameness. The name "Milnor set" 
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occurs in [NZ] too. Distance functions like p are also central ingredients in defining regular 
stratifications, e.g. Mather [Ma], Kuo [Ku], Bekka [Be]. 

Example 5.4. Let p : M" ^ M>o, p{x) = (ELi l^iP^O^^^^. where {wi,...,Wn) e N", 
p = lcm{u;i, . . . ,Wn} and WiPi = p, Vz. This function is "adapted" to polynomials which 
are quasihomogeneous of type {wi, . . . , By using it, one can show that a value c G M 
is atypical for such a polynomial if and only if c is a critical value of / (hence only the 
value can be atypical). Namely, let Ej. := {x G M" | p{x) < r} for some r > 0. Then 
the local Milnor fibre of / at G M" (i.e. f~^{c) fl E,,, for some small enough e and 
< |c| <^ e) is diffeomorphic to the global fibre /^^(c), since /~^(c) is transversal to dEr, 
Vr > e. 

5.2. t-regularity implies p^-regularity. 

Proposition 5.5. Let X C M" &e semi-algebraic and let f : X MP be a nontrivial semi- 
algebraic mapping, where n > p. If f is t-regular at po G X°° then f is pE-regular at 

Po- 

Proof. We may assume without loss of generality that po = ([0 : : ... : 1],0,...0). 

Let c/°° : X n f/„ X MP ^ M>o, (y,t) ^ and note that d°^(y,t) = As 

usual, we denote by g the projection to the variable yo. At po, the functions g"^ and 
d°° differ by a unit, they have the same zero locus X°° and the same levels. Therefore 

c~ = c,,p„(x\x- n {Un X w)) = c,2,p„(x\x- n (f/„ x w)) = c,o.,p^(x\x- n {u, x w)), 

where the last equality follows by Lemma 2.3. 

The t-regularity at p (Definition 2.5) is therefore equivalent to: 

(15) a(P" X w) n Cdco_p,xx\x°^ n f/, X Rp) = 

which implies that, in some neighbourhood of po intersected with M", the fibres {r = 
const.} are transverse to the levels of the function d°°, which coincide with the levels of 
the function pE- □ 

Remark 5.6. The converse of Proposition 5.5 is not true, see Example 5.9. 

We have the following general structure result: 

Theorem 5.7. Let f : X —> MP be a -mapping on a submanifold X C MP' , where 
dimX > p > 0. Then: 

(a) (Fibration theorem) 

S{f) is a closed set. If X is moreover closed, then Ap^^ := /(Sing/) U S{f) is a 
closed set and the restriction: 

f]:X\f-\Ap,)^M^\Ap, 

is a locally trivial fibration over each connected component ofM^ \ (Ap^)- 
In particular B{f) C Ap^^. 

(b) (Semi-algebraic Morse-Sard theorem for asymptotic non-regular values) 

Assume that X is semi- algebraic and that f is a semi- algebraic mapping. 
Then S{f) and Ap^^ are semi-algebraic sets of dimension < p — 1. 
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By chaining Theorem 3.1 to Proposition 5.5, we get: 



Corollary 5.8. Let f : M" MP be a nontrivial semi-algebraic mapping. If f is 
KOS-regular at Pq G X°° then f is pE-regular atp^. In particular, one has the inclusions: 

(16) ^(/)ci^oo(/) and A.^^Akos- 

□ 

The above results prove that Theorem 5.7 extends the main result of [KOS], and this 
extension turns out to be strict, as showed by the next example. 

Example 5.9. [PZ] The polynomials /n,^ : ^ C, fn,q{x,y,z) := x - 3a;2"+^y2g ^ 
22;3n+i^3(} _|_^^^ where n,q E N\{0}, are pe-regular at infinity, more precisely S{fn.q) = 0. 
Then it is shown in [PZ] that fn,q satisfies Malgrange's condition (hence it is t-regular at 
infinity) for any t G C if and only if n < q. For n > q we therefore get = S{fn.q) C 
Kooifn.q) 7^ 0- In particular, for n > g the polynomial is p-regular but not t-regular. 

Example 5.10. Let / : _^ f{x,y,z) = {x'^,xy). We have = AU B, where 
A = {([0 : : c : rf], (0, ts)) G x M^} and 5 = {([0 : : : 1], (ti, ta)) G x | > q}, 
and that := Z n {H°° x M^) = {([0 : : y: z], (^1,^2)) G x M^}. Thus X~ C 
and by straightforward computations we get that / is not "fair" in the sense of Gaffney at 
any point po G X°°. Therefore one cannot use Gaffney's approach for /. Nevertheless, we 
still have the equivalence of t-regularity with the Malgrange-Gaffney condition (Theorem 
3.1) and the fibration theorem (Theorem 5.7), see also Figure 1. 

By straightforward computations one gets /(Sing/) = {(0,0)} and B{f) = K{f) = 
5(/) = r(A) = {(0,t2);t2GK}. 

6. Proof of Theorem 5.7 

6.1. Proof of (b). The image /(Sing/) by / of the semi-algebraic set Sing/ is semi- 
algebraic, by the Tarski-Seidenberg theorem, and of dimension < p — 1 by the semi- 
algebraic Sard theorem. 

To show that S{f) is semi- algebraic, we use the semi-algebraic embedding ip : MJ^ — )■ 

X (xi, . . . , x„) ^ (^7^, ^7^, • • • , /(x)) . Let V, := H 

{(^0,^1, ■■■,Zn,t) G M''+^ X RP I zo = 0} and let vr : x ^ Rf be the canonical 

projection. Then Vi is semi-algebraic and S{f) = 7r(Vi), so we may conclude by the 
Tarski-Seidenberg theorem. 

To prove the dimension assertion for S{f) we need some preliminaries. 

Partial Thom stratification at infinity. We show that X°° may be endowed with 
a stratification having good enough properties such that one may use it to define the 
stratified singular locus of r|x°o. By "stratifications" we mean, as usual, locally finite 
stratifications satisfying the frontier condition. For some strata A, B, we write B -< A to 
say that B cA\A. 

Proposition 6.1. Let f : X ^ be a semi-algebraic C^-mapping on a semi- algebraic 
subset X C R". There exists a semi- algebraic Whitney (a)-regular stratification S of H 
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such that X°° is a union of strata, and that any pair of strata B ~< A, with A C X \ X°° 
and B C X°°, satisfy the Thorn (ag)-regularity condition with respect to some function g 
defining locally X°° in X. 

Proof. We follow [Ti2, §2] and start with some Whitney (a)-regular stratification of X 
with semi-algebraic strata; this exists after Whitney [Wh], see also [GWPL, Ch. I]. One 
then refines it to a semi-algebraic stratification such that X°° is a union of strata, see 
[GWPL, Ch. I]. Next, since the (ag)-regularity condition is stratifiable (see e.g. [GWPL, 
Ch. I], [DLS], [Be, §3]), applying the Thom condition to the pairs of strata as in the 
above statement yields a further refinement which is the desired stratification S, at least 
locally. 

We however need to show that this refinement is a globally defined stratification of X°°. 
The argument goes as follows: in the (ag)-regularity test one uses the limits at some point 
of X°° of the tangent hyperplanes along strata coming from X \ X°°. These limits are 
precisely described by the space of characteristic covectors at infinity But by Lemma 
2.3, C°° is independent of the function g defining X°° locally. □ 

Definition 6.2. One calls partial Thom stratification at infinity a stratification S as in 
Proposition 6.1. 

Such stratifications^ depend of course on the embedding X C M". 

With these notations and definitions, let S = {S'jjjg/ be a semi-algebraic partial Thom 
stratification at infinity, the existence of which has been proved above. Consider the 
projection r : P" x — and to e MJ'. The critical locus at infinity of the restriction 
r|x with respect to S is defined as follows: 



Since the stratification of X°° is in particular Whitney (a)-regular, it follows that Sing^r|x 
is a closed semi-algebraic subset of X°°. Then, by the semi- algebraic Sard theorem, the 
image r(Sing^r|x) C MP is semi-algebraic and of dimension < p — 1. 
It also follows from the definition that: 



which implies that MP\r(Sing^r|x) is included in the set of t-regular values of /. Therefore, 
by Proposition 5.5, we get the inclusion MP \ r(Sing^r|x) C \ S{f), which shows that 
dim S{f) < p — 1. 

6.2. Proof of (a). Let to ^ ^if) {^ijieN C S{f) be a sequence such that 

liTcii^ooti = to- By definition, for every i we have a sequence {xj^fcjfcgpj C M.{f) such 
that limfc_^oo \\^i,k\\ ~ ^ ^^^k^oo f {^i,k) = ti. For each i, there exists k{i) G N such 
that if /c ^ k{i) then ||xj^fc|| > i and \f{xi^k) — ti\ < 1/i. Setting Xj := Xi,k{i), one gets a 
sequence {xjjjgp} C A^(/) such that limj_j.oo ||xj|| = oo and limj_j.oo fi^i) = to- This shows 
that to £ S{f), hence S{f) is closed. 




Po ^ Sing^ r|x 



/ is t-regular at po, 



have been introduced in [Ti2, Def. 2.1], [Ti5, Appendix 1], for p = 1. 
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Let us assume now that X is closed and let to ^ /(Sing/) U S{f). We may assume 
that to G /(Sing/) since we have just proved that S{f) is closed. Then there exists a 
sequence {xj jjgpj C Sing/, such that limj_^oo /(xj) = to- If {^jljeN is non-bounded, we 
may choose a subsequence {xjj.}fcgN such that limfc_^oo W^jkW = ^ ^i^d limfc_>oo fi^jk) — ^o- 
Since Sing/ C Ai{f), it follows that to £ S{f) which is closed. If {xjjjgN is bounded, 
then we may choose a subsequence {xjj.}fcgN such that limfc^ooXj^. = xq G X since X is 
assumed to be closed, and that limfc_j.oo fi^jk) = '^o- Since Sing/ is a closed set, this implies 
Xq G Sing/, and we get to = /(xo) G /(Sing/), which shows that to G /(Sing/) U -S'(/). 

Let us finally show the fibration statement. We first prove a fibration result in the 
neighbourhood of infinity. 

Definition 6.3. (Topological triviality at infinity) 

We say that / is topologically trivial at infinity at the value to G MP if there exists a 
compact set K C M"" and a ball Bs C MP centered at to such that the restriction: 

(17) f\:{X\K)nr\Bs)^Bs 
is a trivial topological fibration. 

Note that one may have two situations in which the mapping (17) may be a trivial 
fibration, namely whenever Bs C Im/ or when i?^ C \ Im/. In the later, the fibration 
has empty fibre. 

Proposition 6.4. (p-regularity implies topological triviality at infinity) 

Let f : X ^MP he a C"^ mapping, for n > p. If the fibre f^^ifo) is p-regular at infinity, 
then f is topologically trivial at infinity at to- 

In particular, f is topologically trivial at infinity at any value ofM^ \ S{f). 

Proof. Let to ^ S{f). Since S{f) is a closed set (as proved just above), there exists a 
closed ball D centered at to and included in M^ \ S{f). Then there exists some large 
enough radius Rq ^ such that: 

(18) M{f)nf-\D)\Bl^ = (l}. 

Indeed, if this were not true, then there exists a sequence {x/^.}fcgr^ C f^^{D) fl A^(/) with 
limfc_^oo llxfcll = oo and since D is compact, one may extract a sub-sequence {xfc-}jgN C 
M.{f) with limfe_5.oo /(xfcj = t ^ D, which gives a contradiction to D fl S{f) = 0. 

To prove the topological triviality at infinity at to it is enough to show that the mapping: 

(19) f]:f~\D)\B-^D 

is a trivial fibration on the manifold with boundary {f^^(D) \ B^^, f~^{D) fl S^'^^), for 
any R > Rq. This is a submersion by (18) but it is not proper, so one cannot apply 
Ehresmann's theorem directly. Instead, we consider the map (/, p) : f^^{D) \ B'^ — 
D X [R, oo[. Now, as a direct consequence of its definition, this is a proper map. It is still 
a submersion by (18) and since Sing(/, p) = A4{f). We then apply Ehresmann's theorem 
to the mapping (/, p) in order to conclude that it is a locally trivial fibration, hence trivial 
over D x [R, oo[. Take now the projection tt : D x [R,oc[-^ D which is a trivial fibration 
by definition and remark that our map (19) is the composition vr o (/, p) of two trivial 
fibrations, hence a trivial fibration too. □ 
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Remark 6.5. It is interesting to point out that the imphcation in the above proposition 
is not an equivalence in generaL The paper [TZ] presents an example of a polynomial 
mapping / : — )■ M which is not p£;-regular at infinity at the value 0, thus not KOS- 
regular either, but it is C°° trivial at infinity at 0. It is easier to give such examples in 
the topological cathegory, for instance f{x,y) = which is topologically equivalent to 
the projection on x, whereas S{f) = {0}. 

We now complete the proof of Theorem 5.7(a). Since W \ (/(Sing/) U S{f)) is an 
open set, for any fixed to ^ /(Sing/) U S{f) there exists a closed ball D centered at to 
such that D G MP \ /(Sing/) U S{f). By the above proof of Proposition 6.4 and using 
the same notations, one has the trivial fibration (19) on the manifold with boundary 
{f-\D) \ B% r\D) n 5^1), for any R > Ro. 

Next, since D fl /(Sing/) = 0, the restriction: 

(20) f]:r\D)nBl^^D 

is a proper submersion on the manifold with boundary {/"^(D) fl B^^, f^^{D) fl S''^'^'^) 
and therefore a locally trivial fibration by Ehresmann's theorem, hence a trivial fibration 
over D. 

We finally glue together the two trivial fibrations (20) and (19) by using an isotopy and 
the trivial fibration from the following commutative diagram, for some R > Rq. 

iBn\BR,)nr\D)^Dx[Ro,R] 

(21) 

F X D X [Ro, R] ^ D 

where F denotes the fibre of the trivial fibration f\ : Sr (1 f~^{D) — )■ D and does not 
depend on the radius R > Rq. □ 

Remark 6.6. If in Theorem 5.7(a) we do not assume that X is closed then the fibration 
assertion holds if one replaces in the statement /(Sing/) by its closure /(Sing/). 
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